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CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] Pursuant to 35 U.S.C. § 119(a), this application claims the benefit 
of earlier filing date and right of priority to the Korean Application No. 2002-63207, 
10 filed on October 16, 2002, the content of which is hereby incorporated by 
reference herein in its entirety. 

BACKGROUND OF THE INVENTION 

15 Field of the Invention 

[0002] The present invention relates to a method for determining a 
motion vector and a macroblock type, and in particular to a method for determining 
a motion vector and a macroblock type of a frame transmitted without being 
skipped in a frame-rate conversion transcoder. 

20 

Description of the Prior Art 

[0003] Video on Demand (VOD) or video streaming service is for 
transmitting requested video contents selectively by storing video contents as 
compressed file formats in a transmission server. Servicing video contents in a 
25 mobile communication network with low channel bandwidth or the Internet having 

l 



variable channel bandwidth is challenging because channel bandwidth can be 
sharply reduced or congestion can occur. 

[0004] To resolve these problems the transmission server has to reduce 
the video transmission frame-rate. A frame-rate conversion transcoder is utilized 
5 for adjusting a video transmission frame-rate. Figure 1 is a block diagram 
illustrating operation of a general frame-rate conversion video transcoder. 

[0005] In general, a moving picture such as a moving picture experts 
group (MPEG) is compressed through predictive encoding. In the predictive 
encoding, a signal value of a certain pixel is obtained by using difference between 
10 image signal values in different times. Each frame of moving picture has 
temporal correlation with each other. The frame is constructed with plural 
macroblocks. The macroblocks can be divided into inter type or intra type 
macroblocks. 

[0006] Referring to Figure 1, the frame-rate conversion video transcoder 
15 10 includes a frame skipper 11 for skipping a frame in order to convert high frame- 
rate bit sequences into low frame-rate bit sequences; and an estimator 12 for 
allocating a new motion vector and a macroblock type of a following frame by 
using the frame skipped in the frame skipper 11 as a prediction reference. 

[0007] When a certain frame is skipped in order to reduce the video 
20 transmission frame-rate, the following frame uses the skipped frame as a 
reference for prediction. Thus, a new motion vector and a new macroblock type 
have to be determined. 

[0008] In order to determine a new motion vector, a FDVS (forward 
dominant vector selection) method has been presented by J. Youn and M. Sun 
25 ("Motion vector refinement for high-performance transcoding" IEEE Trans, on 



Multimedia, vol. no.1. pp30-40, Mar. 1999). In an encoder, computational 
complexity required for estimating a motion vector is as great as 70% of a total 
computational complexity. Accordingly, the method for determining a new motion 
vector by using the previously obtained motion vector without performing motion 

5 vector estimation again has been presented by Youn and Sun. 

[0009] Figure 2 shows a current FDVS method. The FDVS method will 
be described with reference to an example skipping a frame N-1 in transmission. 
In the current FDVS method, among four macroblocks of the skipped frame, a 
motion vector of the macroblock having the greatest overlapped portion with a 

10 macroblock to be predicted is defined as a dominant motion vector. The 
dominant motion vector is defined as a motion vector of the macroblock of the 
skipped frame. 

[0010] As depicted in Figure 2, a macroblock having the greatest 
overlapped portion with a macroblock predicted by a motion vector MV N allocated 
is to a macroblock MB N of a frame N is called MB^-i, and a motion vector allocated to 
the macroblock MB N -i is called MV N -i. 

[0011] Accordingly, a new motion vector MV' N of the macroblock MB N of 
a frame N following after a skipped frame N-1 can be calculated by adding the 
motion vector MV N allocated to the macroblock MB N to the motion vector MB N -i 
20 allocated to the macroblock MV N -i. Equation 1, below, shows calculating the new 
motion vector MV' N of the macroblock MB N of the frame N. 

MV' N = MV N + MVn-i (Equation 1 ) 

[0012] As depicted in Equation 1, in the current FDVS, the previously 
obtained motion vector is utilized to determine a new motion vector about a frame 
25 to be transmitted after the skipped frame. However, by applying Equation 1 



without considering a macroblock type of the macroblock MB N of the frame N, the 
following problems may occur. 

[0013] First, when the macroblock MB N -i of the frame N-1 is an 'intra 
type', a newly allocated motion vector MV' N is defined by Equation 2, provided 
5 below. Herein, a macroblock of the Intra type' does not have a motion vector, a 
motion vector MV N .! to be allocated to the macroblock MB N -i is (0,0). 

MV' N = MV N + (0,0) = MV n (Equation 2) 

[0014] In Equation 2, the macroblock predicted by the motion vector 
MV N in the frame N-2 is matched so as to be the most similar to the macroblock 
10 predicted by the motion vector MV N in the frame N-1 . However, since the frame N- 
1 and the frame N-2 have different characteristics, an optimum matching is not 
achieved. 

[0015] Second, when the macroblock MB N of the frame N is a 'skipped 
type', in the FDVS method, regardless of a macroblock type of the skipped frame 

15 N-1, the macroblock MB N is determined as the 'skipped type'. However, when a 
macroblock of the frame N-1 located at the same position with the macroblock 
MB N of the frame N is an 'intra type' or an 'inter type 1 , the macroblock MB N is not 
coincided with a macroblock type of the frame N-1. In more detail, a reproduced 
image of the macroblock MB N decoded by using the frame N-2 as a reference 

20 image is different from actual image data of the macroblock MB N . 

[0016] As described above, by estimating a new motion vector without 
considering a macroblock type of a frame skipped in transmission and a 
macroblock type of a frame predicted on the basis of the skipped frame, an image 
is reproduced through a decoder of a reception block that may be different from an 

25 actual image. As a result error may be accumulated in following images, and 



accordingly picture quality may be deteriorated. Methods and systems are 
needed that can overcome the above shortcomings associated with the current 
FDVS method. 



5 SUMMARY OF THE INVENTION 

[0017] In order to solve the above-mentioned problem, it is an object of 
the present invention to provide a method for determining a motion vector and a 
macroblock type capable of accurately determining a motion vector and a 
macroblock type of a frame transmitted without being skipped in a video 

10 transcoder. 

[0018] A motion vector and macroblock type determining method is 
provided. The method comprises receiving a high frame-rate video stream 
having N frames; skipping a frame N-1 ; allocating a motion vector to a macroblock 
of frame N according to a macroblock type of the skipped frame N-1; allocating a 

is macroblock type to a macroblock type of frame N according to a macroblock type 
of the skipped frame N-1 ; and outputting a low frame-rate video stream. 

[0019] The macroblock type of the frame N is divided into an inter type 
and a skipped type. The motion vector of the macroblock of the frame N is 
determined according to a macroblock type of the skipped frame N-1 when the 

20 macroblock of the frame N is an inter type. The macroblock type of the frame N 
is determined according to a macroblock type of the frame N-1 located at 
approximately similar position with the macroblock of the frame N when the 
macroblock of the frame N is a skipped type. 

[0020] In some embodiments, the method further comprises determining 

25 a new motion vector of the macroblock of the frame N when the new macroblock is 
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an inter type. The new motion vector of the macroblock of the frame N is 
determined so as to be same with a motion vector of the macroblock of the frame 
N-1 located at approximately a similar position with the macroblock of the frame N. 
[0021] In accordance with one embodiment, a motion vector and 

5 macroblock type determining method comprises determining whether a 
macroblock of a frame N transmitted after a skipped frame N-1 is an inter type or a 
skipped type; allocating a new motion vector for the frame N according to a 
macroblock type of the skipped frame N-1 when a macroblock of the frame N is an 
intra type; and determining a new macroblock type for the frame N according to a 

10 macroblock type of the frame N-1 located at approximately a similar position with 
the macroblock of the frame N when the macroblock of the frame N is a skipped 
type. 

[0022] In certain embodiments, it is determined if a macroblock type of 
the skipped frame N-1 when the macroblock of the frame N is an intra type; such 

is that an infinite motion vector to the macroblock of the frame N when the 
macroblock of the skipped frame N-1 is an intra type is allocated; the same motion 
vector of the macroblock of the frame N when the macroblock of the skipped frame 
N-1 is a skipped type is allocated; and sum total of a motion vector allocated to 
macroblock of the frame N and a motion vector allocated to macroblock of the 

20 frame N-1 as a new motion vector of the macroblock of the frame N is allocated, 
when the macroblock of the skipped frame N-1 is an inter type. 

[0023] In one embodiment, the method further comprises determining a 
macroblock type for the frame N-1 located at approximately a similar position with 
the macroblock of the frame N when the macroblock of the frame N is a skipped 

25 type; determining the macroblock of the frame N as an intra type when the 



macrpblock of the frame N-1 is an intra type; determining the macroblock of the 
frame N as a skipped type when the macroblock of the frame N-1 is a skipped 
type; and determining the macroblock of the frame N as an inter type when the 
macroblock of the frame N-1 is an inter type. 
5 [0024] A motion vector is allocated about the macroblock of the frame N 

when the macroblock of the frame N is an inter type. The motion vector is 
allocated so as to be similar to the motion vector of the macroblock of the frame N- 
1 located at approximately a same position with the macroblock of the frame N. 

[0025] In accordance with yet another embodiment, a motion vector and 

10 macroblock type determining method are provided. The method comprises 
examining a macroblock of a frame N transmitted after a skipped frame N-1 is an 
inter type; determining a macroblock type of a frame N-1 ; and allocating a new 
motion vector for a macroblock of the frame N, according to the macroblock type 
of the frame N-1 . The macroblock type of the frame N-1 is divided into an intra 

15 type, a skipped type and an inter type. 

[0026] In some embodiments, the new motion vector is determined 
based on an equation MV' N = MV N + MV N -i. wherein MV' N is a motion vector 
allocated to a macroblock of the frame N, MVn is a motion vector of a macroblock 
of the frame N, and MV N -i is a motion vector of a macroblock of the frame N-1. 

20 MVn-i has an approximately infinite value when the macroblock of the frame N-1 is 
an intra type. MV N -i has an approximately 0 value when the macroblock of the 
frame N-1 is a skipped type. 

[0027] The new motion vector allocating step comprises allocating an 
infinite motion vector to a macroblock of the frame N when the macroblock of the 

25 skipped frame N-1 is an intra type; allocating a motion vector of the macroblock of 



the frame N when the macroblock of the skipped frame N-1 is a skipped type; and 
allocating approximately sum of a motion vector allocated to the macroblock of the 
frame N and a motion vector allocated to the macroblock of the frame N-1 as a 
new motion vector for the macroblock of the frame N when the macroblock of the 

5 skipped frame N-1 is an inter type. 

[0028] In accordance with yet another embodiment, a motion vector and 
macroblock type determining method is provided. The method comprises 
examining a macroblock of a frame N transmitted after a skipped frame N-1; 
examining a macroblock type of a frame N-1 located at approximately a similar 

10 position with the macroblock of the frame N; and determining if the macroblock 
type of the frame N is same as the macroblock type of the frame N-1. The 
macroblock of the frame N is determined as an intra type, when the macroblock of 
the frame N-1 is an intra type. 

[0029] The macroblock of the frame N is determined as a skipped type, 

15 when the macroblock of the frame N-1 is a skipped type. The macroblock of the 
frame N is determined as an inter type, when the macroblock of the frame N-1 is 
an inter type; and a new motion vector of the macroblock of the frame N is 
allocated. In one embodiment, a motion vector of the macroblock of the frame N- 
1 located at approximately same position with the macroblock of the frame N is 

20 allocated as a new motion vector of the macroblock of the frame N. 

[0030] These and other embodiments of the present invention will also 
become readily apparent to those skilled in the art from the following detailed 
description of the embodiments having reference to the attached figures, the 
invention not being limited to any particular embodiments disclosed. 

25 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0031] The accompanying drawings, which are included to provide a 
further understanding of the invention and are incorporated in and constitute a part 
5 of this specification, illustrate embodiments of the invention and together with the 
description serve to explain the principles of the invention. 

[0032] Figure 1 is a block diagram illustrating operation of a general 
frame-rate conversion video transcoder; 

[0033] Figure 2 illustrates an example of a related art FDVS method; 
10 [0034] Figure 3 illustrates an exemplary method, in form of a machine- 

readable code, for newly allocating a type of a macroblock MB N , in accordance 
with one embodiment of the invention; 

[0035] Figure 4 is a flow chart illustrating a method for determining a 
motion vector and a macroblock type in accordance with one embodiment of the 
15 present invention; and 

[0036] Figures 5A and 5B illustrate exemplary graphs for comparing 
performance of an FDVS method, in accordance with the related art, with that of 
an improved FDVS method in accordance with one embodiment of the present 
invention. 

20 [0037] Features, elements, and aspects of the invention that are 

referenced by the same numerals in different figures represent the same, 
equivalent, or similar features, elements, or aspects in accordance with one or 
more embodiments of the system. 

25 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0038] Hereinafter, a preferred embodiment of a method for determining 
a motion vector and a macroblock type in accordance with the present invention 
will be described with reference to accompanying drawings. The method for 
5 determining a motion vector and a macroblock type in accordance with the present 
invention can solve the problems associated with the current FDVS method. 

[0039] In accordance with one or more embodiments of the invention, 
when the frame N-1 skipped in transmission includes an intra type macroblock, a 
new motion vector is defined by Equation 3, below: 

10 MV'n = MV N + (oo , oo) = (oo , oo) (Equation 3) 

[0040] For example, a motion vector (0, 0) is allocated to the intra type 
macroblock. In one embodiment of the invention, an infinite motion vector is 
allocated to the macroblock MB N of the frame N and the macroblock MB N is 
determined as the intra type. 
15 [0041] When the macroblock MB N of the frame N transmitted after the 

skipped frame N-1 is a skipped type, newly allocated macroblock type and motion 
vector are determined. In some embodiments, regardless of a macroblock type 
of the skipped frame N-1 , a macroblock of the frame N is determined as a skipped 
type. In certain embodiments of the invention, however, according to a macroblock 
20 type of the frame N-1 located at the same position with the macroblock MB N , a 
macroblock type and a motion vector of the macroblock MB N are determined. 

[0042] In more detail, when a macroblock type of the frame N-1 located 
at the same position with the macroblock MB N is an intra type, a newly allocated 
macroblock MB N is an intra type. When a macroblock type of the frame N-1 is an 
25 inter type, a newly allocated macroblock MB N is an inter type. When a 



macroblock type of the frame N-1 is a skipped type, a newly allocated macroblock 
MB N is a skipped type. 

[0043] Referring to Figure 3, a process for newly allocating a type of a 
macroblock MB N is provided, when the macroblock MB N of the frame N is a 
5 skipped type. Accordingly, MB_type_ MB N is a type of the macroblock MB N , and 
MB_type_skipped_frame is a type of a macroblock located at the same position 
with the macroblock MB N in the frame N-1. 

[0044] Referring to Figure 4, a method for determining a motion vector 
and a macroblock type in accordance with one embodiment of the present 
10 invention is provided. When frame N-1 is skipped in the video stream inputted to 
the frame-rate conversion video transcoder (step S11), a motion vector and a 
macroblock type of the frame N as the reference frame for predicting the frame N- 
1 are reallocated. 

[0045] It is judged whether the macroblock MB N of the frame N is an 
15 inter type or a skipped type (step S12). When the macroblock MB N is an inter 
type, a motion vector reallocating process is performed. When the macroblock 
MB N is a skipped type, a process for allocating a pertinent macroblock type and a 
motion vector is performed. When the macroblock MB N is an intra type, it is 
considered that the operation has no correlation with a previous frame (i.e., when 
20 a scene conversion is performed). Accordingly there is no need to perform the 
motion vector reallocating process. 

[0046] In certain embodiments, the motion vector and macroblock type 
determining process of the macroblock MB N will be described with two cases (e.g., 
whether the macroblock MB N is an inter type or a skipped type). First, if the 
25 macroblock MB N is an inter type, it is determined whether a type of a macroblock 



MBn-i of the skipped frame N-1 is an intra type (step S13). If the macroblock 
MBn-i is an intra type, by applying Equation 3, a new motion vector about the 
macroblock MB N is determined (step S14). A newly allocated motion vector is 
an infinite motion vector, in accordance with one or more embodiments. 

5 [0047] When the macroblock MBn-i of the skipped frame N-1 is not an 

intra type, it is judged whether the macroblock MB N -i is a skipped type (step S15). 
When the macroblock MB N -i is the skipped type, by applying Equation 2, a new 
motion vector about the macroblock MB N -i is determined (step S16). In more 
detail, when the macroblock MB N -i is the skipped type, because the macroblock 

10 does not have a motion vector, a motion vector MV N allocated to the macroblock 
MB N and the newly allocated motion vector are the same. 

[0048] When the macroblock MB N .i of the skipped frame N-1 is an inter 
type, by applying Equation 1 alike the conventional FDVS, a new motion vector 
about the macroblock MB N is determined (step S17). If the macroblock MB N of 

15 the frame N is an inter type, in consideration of the macroblock type of the 
macroblock MB N --i of the skipped frame N-1, a type of the macroblock MB N is 
allocated. 

[0049] In some embodiments, is judged whether a macroblock located at 
the same position with the macroblock MB N in the skipped frame N-1 is an intra 

20 type (step S18). When the macroblock of the frame N-1 is an intra type, the 
macroblock MB N is determined as an intra type (step S19). When the macroblock 
of the frame N-1 is a skipped type (step S20), the macroblock MB N is determined 
as a skipped type (step S21). When the macroblock of the frame N-1 is an inter 
type, the macroblock MB N is determined as an inter type (step S22). 

25 [0050] In one embodiment, after the macroblock MB N is determined as 



the inter type, a motion vector corresponded to the macroblock of the frame N-1 is 
allocated as a motion vector of the macroblock MB N (step S23). That is, when 
the macroblock MB N is the intra type or the skipped type, there is no need to 
allocate a new motion vector. However, when the macroblock MB N is an inter type, 
5 a motion vector allocated to the macroblock of the frame N-1 is allocated as a new 
motion vector. 

[0051] When the macroblock MB N is the skipped type, according to a 
macroblock type of the frame N-1 located at the same position with the 
macroblock MB N , a type of the new macroblock MB N is determined. Although a 
10 macroblock of a frame transmitted without being skipped through the frame-rate 
conversion video transcoder is an intra type or a skipped type, the motion vector 
and macroblock type determining method in accordance with the present invention 
can be applied. 

[0052] The present invention is capable of reducing generated bit 
15 quantity in a video stream and improving picture quality in reproducing of images. 
Tables 1 and 2 are for comparing performance of the FDVS method with that of an 
improved FDVS method in accordance with the present invention. In Tables 1 
and 2, video bit sequence MPEG-1 encoded as 30 frames per second is 
respectively converted into 15 frames and 7.5 frames. 

20 



[Table 1] 



Test 


Conventional FDVS 


Improved FDVS 


Image 


Generated Bit 


Average 


Generated Bit 


Average 




Quantity 


PSNR (dB) 


Quantity 


PSNR (dB) 




(bytes) 




(bytes) 





Football 


845061 


29.19 


831462 


29.58 


Table Tennis 


467328 


30.79 


456531 


31.37 


Garden 


1217779 


27.93 


1193164 


28.43 


[Table 2] 


Test 


Conventional FDVS 


Improved FDVS 


Image 


Generated Bit 


Average 


Generated Bit 


Average 




Quantity 


PSNR (dB) 


Quantity 


PSNR (dB) 




(bytes) 




(bytes) 




Football 


489008 


28.99 


469577 


29.34 


Table Tennis 


302333 


30.68 


291734 


31.16 


Garden 


779824 


27.59 


764982 


27.94 



[0053] In Tables 1 and 2, by using football, table tennis and garden 
5 images of 120 frames as test images, a conventional FDVS method is compared 
with the improved FDVS method in accordance with the present invention in the bit 
generated quantity and picture quality aspects. Herein, a measure of the picture 
quality comparison is PSNR, for example. 

[0054] In comparison with the conventional FDVS method, picture 
10 quality is improved at maximum 0.6 dB and generated bit quantity is reduced in 
the improved FDVS method. In more detail, in the FDVS method in accordance 
with the present invention, it is possible to reduce generated bit quantity and 
improve picture quality simultaneously. 

[0055] Referring to Figures 5A and 5B, table tennis images as MPEG-1 
15 encoded 120 frames by 1 .5Mbps are used as test images, and the test images are 
converted into 15 frames per second through the frame-rate conversion video 
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transcoder, for example. Sequence conversion occurs in the 68th frame and the 
98th frame of the test images. When the sequence conversion occurs, many 
macroblocks in a P-frame are determined as intra types due to performance 
lowering of predictive encoding. 

5 [0056] Figure 5A is a graph for comparing PSNR by each frame when 

the test images are converted into 15 frames per second. In applying of the 
conventional FDVS method, after the 68th frame and the 98th frame at which the 
sequence conversion occur are skipped, picture quality is lowered sharply at the 
69th frame and the 99th frame, for example. However, in applying the improved 

10 FDVS method in accordance with the present invention, the same picture quality 
can be maintained at the 69th frame and the 99th frame. 

[0057] Figure 5B is a graph showing the number of intra type 
macroblocks and the number of skipped type macroblocks generated at each 
frame of the test sequences. At the 68th frame and the 98th frame in which 

is sequence conversion occurs, the number of intra type macroblocks is increased 
sharply. Accordingly, the motion vector and macroblock type determining method 
considering not only inter type macroblocks but also intra type and skipped type 
macroblocks is required. As such, by applying the present invention considering 
a type of each macroblock, picture quality can be improved. 

20 [0058] In the motion vector and macroblock type determining method in 

accordance with the present invention, it is possible to reallocate accurately a 
motion vector and a macroblock type of a frame transmitted without being skipped 
through a frame-rate conversion video transcoder. In the motion vector and 
macroblock type determining method in accordance with the present invention, 

25 although performance of predictive encoding such as sequence conversion is 



lowered, it is possible to improve picture quality and reduce generated bit quantity. 

[0059] The embodiments described above are to be considered in all 
aspects as illustrative only and not restrictive in any manner. Thus, other 
exemplary embodiments, system architectures, platforms, and implementations 
5 that can support various aspects of the invention may be utilized without departing 
from the essential characteristics described herein. These and various other 
adaptations and combinations of features of the embodiments disclosed are within 
the scope of the invention. The invention is defined by the claims and their full 
scope of equivalents. 



16 



